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Abstract: In classical information theory, entropy rate and algorithmic com- 
plexity per symbol are related by a theorem of Brudno. In this paper, we prove 
a quantum version of this theorem, connecting the von Neumann entropy rate 
and two notions of quantum Kolmogorov complexity both based on the short- 
est qubit descriptions of qubit strings that, run by a universal quantum Turing 
machine, reproduce them as outputs. 



1. Introduction 

In recent years, the theoretical and experimental use of quantum systems to 
store, transmit and process information has spurred the study of how much of 
classical information theory can be extended to the new territory of quantum 
information and, vice versa, how much novel strategies and concepts are needed 
that have no classical counterpart. 

We shall compare the relations between the rate at which entropy is produced 
by classical, respectively quantum, ergodic sources, and the complexity of the 
emitted strings of bits, respectively qubits. 

According to Kolmogorov |24| . the complexity of a bit string is the minimal 
length of a program for a Turing machine (TM) that produces the string. More in 
detail, the algorithmic complexity K(v- n >) of a string is the length (counted 
in the number of bits) of the shortest program p that fed into a universal TM 
(UTM) il yields the string as output, i.e. il(p) = i' n ). For infinite sequences 
i, in analogy with the entropy rate, one defines the complexity rate as fc(i) := 
lim ra —K(i( n )), where i^ ra ^ is the string consisting of the first n bits of i, [2J. The 
universality of il implies that changing the UTM, the difference in the complexity 
of a given string is bounded by a constant independent of the string; it follows 
that the complexity rate k(i) is UTM- independent. 
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Different ways to quantify the complexity of qubit strings have been put 
forward; in this paper, we shall be concerned with some which directly generalize 
the classical definition by relating the complexity of qubit strings with their 
algorithmic description by means of quantum Turing machines (QTM). 

For classical ergodic sources, an important theorem, proved by Brudno 10 
and conjectured before by Zvonkin and Levin 02| , establishes that the entropy 
rate equals the algorithmic complexity per symbol of almost all emitted bit 
strings. We shall show that this essentially also holds in quantum information 
theory 

For stationary classical information sources, the most important parameter is 
the entropy rate h(w) — lim„ ^H(n^ ), where H(n^ ) is the Shannon entropy of 
the ensembles of strings of length n that are emitted according to the probability 
distribution n( n \ According to the Shannon-McMillan-Breiman theorem [6lll2| . 
h(Tr) represents the optimal compression rate at which the information provided 
by classical ergodic sources can be compressed and then retrieved with negligible 
probability of error (in the limit of longer and longer strings). Essentially, nh(ir) 
is the number of bits that are needed for reliable compression of bit strings of 
length n. 

Intuitively, the less amount of patterns the emitted strings contain, the harder 
will be their compression, which is based on the presence of regularities and 
on the elimination of redundancies. From this point of view, the entropy rate 
measures the randomness of a classical source by means of its compressibility 
on the average, but does not address the randomness of single strings in the 
first instance. This latter problem was approached by Kolmogorov (24125) . (and 
independently and almost at the same time by Chaitin JI] , and Solomonoff 36 ) , 
in terms of the difficulty of their description by means of algorithms executed 
by universal Turing machines (UTM), see also (26) . 

On the whole, structureless strings offer no catch for writing down short 
programs that fed into a computer produce the given strings as outputs. The 
intuitive notion of random strings is thus mathematically characterized by Kol- 
mogorov by the fact that, for large n, the shortest programs that reproduce them 
cannot do better than literal transcription (39) . 

Intuitively, one expects a connection between the randomness of single strings 
and the average randomness of ensembles of strings. In the classical case, this is 
exactly the content of a theorem of Brudno |1(JII41II22II37| which states that for 
ergodic sources, the complexity rate of 7r-almost all infinite sequences i coincides 
with the entropy rate, i.e. k(i) = h(n). 

Quantum sources can be thought as black boxes emitting strings of qubits. 
The ensembles of emitted strings of length n are described by a density operator 
on the Hilbert spaces (C 2 )® n , which replaces the probability distribution 
n ( n ) from the classical case. 

The simplest quantum sources are of Bernoulli type: they amount to infinite 
quantum spin chains described by shift-invariant states characterized by local 
density matrices p^ over n sites with a tensor product structure p^ n ' = p® n := 
®i=l Pi where p is a density operator on C 2 . 

However, typical ergodic states of quantum spin-chains have richer structures 
that could be used as quantum sources: the local states p^ n \ not anymore tensor 
products, would describe emitted n— qubit strings which are correlated density 
matrices. 
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Similarly to classical information sources, quantum stationary sources (shift- 
invariant chains) are characterized by their entropy rate s := lim„ ^rS(p^), 
where S(p^) denotes the von Neumann entropy of the density matrix pw, 

The quantum extension of the Shannon-McMillan Theorem was first obtained 
in for Bernoulli sources, then a partial assertion was obtained for the re- 
stricted class of completely ergodic sources in |17| , and finally in , a complete 
quantum extension was shown for general ergodic sources. The latter result is 
based on the construction of subspaces of dimension close to 2 ns , being typical 
for the source, in the sense that for sufficiently large block length n, their corre- 
sponding orthogonal projectors have an expectation value arbitrarily close to 1 
with respect to the state of the quantum source. These typical subspaces have 
subsequently been used to construct compression protocols 9 . 

The concept of a universal quantum Turing machine (UQTM) as a precise 
mathematical model for quantum computation was first proposed by Deutsch 
[T3| . The detailed construction of UQTMs can be found in PUT]: these machines 
work analogously to classical TMs, that is they consist of a read/write head, a set 
of internal control states and input/output tapes. However, the local transition 
functions among the machine's configurations (the programs or quantum algo- 
rithms) are given in terms of probability amplitudes, implying the possibility of 
linear superpositions of the machine's configurations. The quantum algorithms 
work reversibly. They correspond to unitary actions of the UQTM as a whole. 
An element of irreversibility appears only when the output tape information 
is extracted by tracing away the other degrees of freedom of the UQTM. This 
provides linear superpositions as well as mixtures of the output tape configura- 
tions consisting of the local states 0, 1 and blanks which are elements of the 
so-called computational basis. The reversibility of the UQTMs time evolution is 
to be contrasted with recent models of quantum computation that are based on 
measurements on large entangled states, that is on irreversible processes, subse- 
quently performed in accordance to the outcomes of the previous ones |32| . In 
this paper we shall be concerned with Bernstein- Vazirani-type UQTMs whose 
inputs and outputs may be bit or qubit strings [3]. 

Given the theoretical possibility of universal computing machines working in 
agreement with the quantum rules, it was a natural step to extend the problem 
of algorithmic descriptions as a complexity measure to the quantum case. Con- 
trary to the classical case, where different formulations are equivalent, several 
inequivalent possibilities are available in the quantum setting. In the following, 
we shall use the definitions in |S] which, roughly speaking, say that the algorith- 
mic complexity of a qubit string p is the logarithm in base 2 of the dimension of 
the smallest Hilbert space (spanned by computational basis vectors) containing 
a quantum state that, once fed into a UQTM, makes the UQTM compute the 
output p and halt. 

In general, quantum states cannot be perfectly distinguished. Thus, it makes 
sense to allow some tolerance in the accuracy of the machine's output. As ex- 
plained below, there are two natural ways to deal with this, leading to two 
(closely related) different complexity notions QC^° and QC S , which correspond 
to asymptotically vanishing, respectively small but fixed tolerance. 

Both quantum algorithmic complexities QC^° and QC S are thus measured 
in terms of the length of quantum descriptions of qubit strings, in contrast to 
another definition 40 which defines the complexity of a qubit string as the length 
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of its shortest classical description. A third definition |15| is instead based on 
an extension of the classical notion of universal probability to that of universal 
density matrices. The study of the relations among these proposals is still in a 
very preliminary stage. For an approach to quantum complexity based on the 
amount of resources (quantum gates) needed to implement a quantum circuit 
reproducing a given qubit string see j27U28j . 1 

The main result of this work is the proof of a weaker form of Brudno's theo- 
rem, connecting the quantum entropy rate s and the quantum algorithmic com- 
plexities QC^ and QC S of pure states emitted by quantum ergodic sources. 
It will be proved that there are sequences of typical subspaces of (C 2 )®", such 
that the complexity rates -^QC^-°(q) and -^QC s (q) of any of their pure-state 
projectors q can be made as close to the entropy rate s as one wants by choos- 
ing n large enough, and there are no such sequences with a smaller expected 
complexity rate. 

The paper is divided as follows. In Section 2, a short review of the C*-algebraic 
approach to quantum sources is given, while Section 3 states as our main result 
a quantum version of Brudno's theorem. In Section 4, a detailed survey of QTMs 
and of the notion of quantum Kolmogorov complexity is presented. In Section 5, 
based on a quantum counting argument, a lower bound is given for the quantum 
Kolmogorov complexity per qubit, while an upper bound is obtained in Section 
5 by explicit construction of a short quantum algorithm able to reproduce any 
pure state projector q belonging to a particular sequence of high probability 
subspaces. 

2. Ergodic Quantum Sources 

In order to formulate our main result rigorously, we start with a brief introduc- 
tion to the relevant concepts of the formalism of quasi-local C*-algebras which 
is the most suited one for dealing with quantum spin chains. At the same time, 
we shall fix the notations. 

We shall consider the lattice Z and assign to each site x G Z a C* -algebra 
A x being a copy of a fixed finite-dimensional algebra A, in the sense that there 
exists a ^-isomorphism i x : A — > A x ■ To simplify notations, we write a G A x for 
i x (a) G A x and a G A. The algebra of observables associated to a finite A C Z is 
defined by Aa '■— ® x( za Ae- Observe that for A C A we have A A > = Aa®A A '\ a 
and there is a canonical embedding of Aa into A A > given by a i— > a®\ A ", A , where 
a G Aa and 1 A '\ A denotes the identity of A A >\ A . The infinite-dimensional quasi- 
local C*-algebra A°° is the norm completion of the normed algebra U/icz-^i 
where the union is taken over all finite subsets A. 

In the present paper, we mainly deal with qubits, which are the quantum 
counterpart of classical bits. Thus, in the following, we restrict our considerations 
to the case where A is the algebra of observables of a qubit, i.e. the algebra 
A^2(C) of 2 x 2 matrices acting on C 2 . Since every finite-dimensional unital C*- 
Algebra A is ^-isomorphic to a subalgebra of Ai2(C)® D for some D G N, our 
results contain the general case of arbitrary A. Moreover, the case of classical bits 
is covered by A being the subalgebra of A^C) consisting of diagonal matrices 
only. 



Other considerations concerning quantum complexity can be found in 1381 and 1351 . 
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Similarly, we think of Aa as the algebra of observables of qubit strings of 
length | A\, namely the algebra M 2 \a\ (C) = M 2 (Q®\ A \ of 2^1 x 2l A l matrices 
acting on the Hilbert space Ha '■= (C 2 )®' 71 '. The quasi-local algebra ^4°° corre- 
sponds to the doubly- infinite qubit strings. 

The (right) shift r is a *-automorphism on A°° uniquely defined by its action 
on local observables 

t : a E A[„ hn ] a G -4[ TO+ i, n+ i] (1) 

where [m, n] C Z is an integer interval. 

A state \P on .4°° is a normalized positive linear functional on A°° . Each local 
state <J/i := if - I" yl/i, 4 C Z finite, corresponds to a density operator pa G -4/i by 
the relation ^(a) = Tr (p^a), for all a G >U, where Tr is the trace on (C 2 )® |y11 . 
The density operator qa is a positive matrix acting on the Hilbert space Ha 
associated with A a satisfying the normalization condition TvpA = 1- The sim- 
plest pa correspond to one-dimensional projectors P := \iPa){'4>a\ onto vectors 
\ipA) G Ha and arc called pure states, while general density operators are linear 
convex combinations of one-dimensional projectors: pa — J2i ^ilV/iKV/il: ^ 0: 
J2j = 1. We denote by T^~(H) the convex set of density operators acting on 

a (possibly infinite-dimensional) Hilbert space H, whence pa G T+(Ha)- 

A state & on ^4°° corresponds one-to-one to a family of density operators 
Pa G Aa, A C Z finite, fulfilling the consistency condition p^ = Tr^/^ (P/v) for 
A C A' , where Tr^ denotes the partial trace over the local algebra A a which 
is computed with respect to any orthonormal basis in the associated Hilbert 
space Ha- Notice that a state \P with o T = i.e. a shift-invariant state, is 
uniquely determined by a consistent sequence of density operators p^ :— PA(n) 
in A^ := AaIu) corresponding to the local states i''-™-' := ^A(n)i where A(n) 
denotes the integer interval [l,n] C Z, for each n EN. 

As motivated in the introduction, in the information-theoretical context, we 
interpret the tuple (A°° , &) describing the quantum spin chain as a stationary 
quantum source. 

The von Neumann entropy of a density matrix p is S(p) := — Tr(plogp). By 
the subadditivity of S for a shift-invariant state & on .4°°, the following limit, 
the quantum entropy rate, exists 

s(m := lim -S(p (n) ) . 

n^oo n 

The set of shift-invariant states on A°° is convex and compact in the weak*- 
topology. The extremal points of this set are called ergodic states: they are 
those states which cannot be decomposed into linear convex combinations of 
other shift-invariant states. Notice that in particular the shift-invariant product 
states defined by a sequence of density matrices p^ = p® n , neN, where p is a 
fixed 2x2 density matrix, are ergodic. They are the quantum counterparts of 
Bernoulli (i.i.d.) processes. Most of the results in quantum information theory 
concern such sources, but, as mentioned in the introduction, more general ergodic 
quantum sources allowing correlations can be considered. 

More concretely, the typical quantum source that has first been consid- 
ered was a finite-dimensional quantum system emitting vector states \vi) G C 2 
with probabilities p(i). The state of such a source is the density matrix p = 
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^2iP(i)\vi)(vi\ being an element of the full matrix algebra A^C); furthermore, 
the most natural source of qubit strings of length n is the one that emits vectors 
\vi) independently one after the other at each stroke of time. 2 The corresponding 
state after n emissions is thus the tensor product 

p ®n = ^2 p(ii)p(i 2 ) ■ ■ ■p{i n )\v ll ®v l2 <g> • • -ViJiVii <g> v i2 <g> • • -ViJ . 

In the following, we shall deal with the more general case of ergodic sources 
defined above, which naturally appear e.g. in statistical mechanics (compare ID 
spin chains with finite-range interaction). 

When restricted to act only on n successive chain sites, namely on the local 
algebra A^ = A^^C), these states correspond to density matrices p^ act- 
ing on (C 2 )® n which are not simply tensor products, but may contain classical 
correlations and entanglement. The qubit strings of length n emitted by these 
sources are generic density matrices a acting on (C 2 )®", which are compatible 
with the state of the source 9 in the sense that supp a < supp p^ n \ where 
supp g denotes the support projector of the operator a, that is the orthogonal 
projection onto the subspace where a cannot vanish. More concretely, p^ can 
be decomposed in uncountably many different ways into convex decompositions 
p(n) _ j^. Aicrj™^ in terms of other density matrices er{™' on the local algebra 
A^ each one of which describes a possible qubit string of length n emitted by 
the source. 

3. Main Theorem 

It turns out that the rates of the complexities QC^ (approximation-scheme 
complexity) and QC S (finite-accuracy complexity) of the typical pure states of 
qubit strings generated by an ergodic quantum source (.4°° , <?") are asymptoti- 
cally equal to the entropy rate s(tf') of the source. A precise formulation of this 
result is the content of the following theorem. It can be seen as a quantum ex- 
tension of Brudno's theorem as a convergence in probability statement, while 
the original formulation of Brudno's result is an almost sure statement. 

We remark that a proper introduction to the concept of quantum Kolmogorov 
complexity needs some further considerations. We postpone this task to the next 
section. 

In the remainder of this paper, we call a sequence of projectors p n G A^ , n G N, 
satisfying lim^oo ^^(pn) — la, sequence of ^P-typical projectors. 

Theorem 1 (Quantum Brudno Theorem). 

Let (^4°°,^) be an ergodic quantum source with entropy rate s. For every 
S > 0, there exists a sequence of & -typical projectors q n (S) € A^ n \ n G N, i.e. 
\\m n ^ ao " l l/( n \q n {8)) = 1, such that for n large enough every one- dimensional 
projector q < q n (S) satisfies 

lQC^ (q)e(s-5, s + 8), (2) 

-QC 6 {q) g (s- 6(2 + 8)s,s + 6). (3) 
n 

2 Here we use Dirac's bra-ket notation, where a bra \v) is a vector in a Hilbert space and a 

ket (v\ is its dual vector. 



Entropy and Quantum Kolmogorov Complexity: A Quantum Brudno's Theorem 



7 



Moreover, s is the optimal expected asymptotic complexity rate, in the sense that 
every sequence of projectors q n G A^ n \ n £ N, that for large n may be represented 
as a sum of mutually orthogonal one- dimensional projectors that all violate the 
lower bounds in 0) and for some S > 0, has an asymptotically vanishing 
expectation value with respect to 

4. QTMs and Quantum Kolmogorov Complexity 

Algorithmic complexity measures the degree of randomness of a single object. It 
is defined as the minimal description length of the object, relative to a certain 
"machine" (classically a UTM). In order to properly introduce a quantum coun- 
terpart of Kolmogorov complexity we thus have to specify what kind of objects 
we want to describe (outputs), what the descriptions (inputs) are made of, and 
what kind of machines run the algorithms. 

In accordance to the introduction, we stipulate that inputs and outputs are so- 
called (pure or mixed) variable-length qubit strings, while the reference machines 
will be QTMs as defined by Bernstein and Vazirani 0], in particular universal 
QTMs. 

4--1- Variable- Length Qubit Strings. Let Tik '■= (C^ 0,1 })** be the Hilbert space 
of k Qubits (k e N ). We write C {0 > 1} for C 2 to indicate that we fix two orthonor- 
mal computational basis vectors |0) and Since we want to allow superpositions 
of different lengths fc, we consider the Hilbert space H{o,i}* defined as 

oo 

^{o,i}* := ® 7~Lk ■ 

fe=0 

The classical finite binary strings {0, 1}* are identified with the computational 
basis vectors in W{o,i}*, i.e. H{o,i}* — ^ 2 ({A, 0, 1,00,01, . . .}), where A denotes 
the empty string. We also use the notation 

n 

"H<n '■= ^J^^A; 

and treat it as a subspace of 7i{o.i}*- A (variable-length) qubit string a G 
T L + (H{o i i}») is a density operator on H{o,i}*- We define the length 1(a) G 
No U {oo} of a qubit string a G (H{ ,i}*) as 

1(g) := min{n G N | a G T+(H< n )} (4) 

or as 1(a) = oo if this set is empty (this will never occur in the following). 

There are two reasons for considering variable-length and also mixed qubit 
strings. First, we want our result to be as general as possible. Second, a QTM 
will naturally produce superpositions of qubit strings of different lengths; mixed 
outputs appear naturally while tracing out the other parts of the QTM (input 
tape, control, head) after halting. 

In contrast to the classical situation, there are uncountably many qubit strings 
that cannot be perfectly distinguished by means of any quantum measurement. If 
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p, cr 6 7^ + (7i{o,i}*) are two qubit strings with finite length, then we can quantify 
their distance in terms of the trace distance 

l|p-Hh*:=5&|P-*l = 5Z>l . (5) 

i 

where the are the eigenvalues of the Hermitian operator \p — cr j := 
^(p-a)*(p-a). 

In Subsection 14.31 we will define Quantum Kolmogorov Complexity QC(p) 
for qubit strings p. Due to the considerations above, it cannot be expected that 
the qubit strings p are reproduced exactly, but it rather makes sense to demand 
the strings to be generated within some trace distance S. Another possibility is 
to consider "approximation schemes", i.e. to have some parameter k £ N, and 
to demand the machine to approximate the desired state better and better the 
larger k gets. We will pursue both approaches, corresponding to equations 
and (fTT))> below. 

Note that we can identify every density operator p € on the local n- 

block algebra with its corresponding qubit string p £ T^~(H n ) C T x (Hmn*) 
such that l[p) = n. Similarly, we identify qubit strings a £ (H{ci,\}*) °f finite 
length £ with the state of the input or output tape of a QTM (see Subsection l4.2l) 
containing the state in the cell interval [0,£ — 1] and vice versa. 



4-- 2. Mathematical Description of QTMs. Due to the equivalence of various mod- 
els for quantum computation, the definition of Quantum Kolmogorov Complex- 
ity should be rather insensitive to the details of the underlying machine. Nev- 
ertheless, there are some details which are relevant for our theorem. Thus, we 
have to give a thorough definition of what we mean by a QTM. 

Bernstein and Vazirani Def. 3.2.2) define a quantum Turing machine M 
as a triplet (E,Q,5), where £ is a finite alphabet with an identified blank symbol 

and Q is a finite set of states with an identified initial state go and final state 
Qf Qo- The function 8 : Q x £ —> C^xQxfi.fi} j s ca u ec j ^ ne quantum transition 

function. The symbol C denotes the set of complex numbers a S C such that 
there is a deterministic algorithm that computes the real and imaginary parts 
of a to within 2 _ ™ in time polynomial in n. 

One can think of a QTM as consisting of a two-way infinite tape T of cells 
indexed by Z, a control C, and a single "read/write" head H that moves along 
the tape. A (classical) configuration is a triplet ((c7i)i e z, q, k) £ I7 Z xQxZ such 
that only a finite number of tape cell contents cr, are non-blank (q and k are the 
state of the control and the position of the head respectively) . Let C be the set 
of all configurations, and define the Hilbert space Hqtm ■— £ 2 (C), which can 
be written as Hqtm = He ® Tin ® Ht- 

The transition function S generates a linear operator Um on Hqtm describing 
the time evolution of the QTM. We identify a £ (W{o,i}») with the initial 
state of M on input cr, which is according to the definition in 0] a state on 
Hqtm where tr is written on the input track over the cell interval [0, 1(a) — 1], 
the empty state # is written on the remaining cells of the input track and on 
the whole output track, the control is in the initial state qo and the head is in 
position 0. Then, the state M'(tr) of M on input a at time t £ No is given by 
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M t (a) — (U a/)* <J {UIjY . The state of the control at time t is thus given by partial 
trace over all the other parts of the machine, that is Mq(<t) := Tth.t (M t (a)). 
In accordance with 0], Def. 3.5.1, we say that the QTM M halts at time t G No 
on input a G T-^~ (Tt{ iy), if and only if 

(q f \M t c (a)\q f )=l and (q f \M t c (a)\q f )=0 for every t' < t , (6) 

where q/ S Q is the special state of the control (specified in the definition of M) 
signalling the halting of the computation. 

Denote by H(t) c W{o,i}* the se t of vector inputs with equal halting time t. 
Observe that the above definition implies that Tt(t) :— {c \<p) : c 6 C, \4>) G 
H(t)} is equal to the linear span of H(t), i.e. H(t) is a linear subspace of 7i{o,i}* ■ 
Moreover for t ^ t' the corresponding subspaces H(t) and Tt(t') are mutually 
orthogonal, because otherwise one could perfectly distinguish non-orthogonal 
vectors by means of the halting time. It follows that the subset of 7^ + (H/o,i}*) 
on which a QTM M halts is a union {J teN T^(H(t)). 

For our purpose, it is useful to consider a special class of QTMs with the 
property that their tape T consists of two different tracks, an input track I 
and an output track O. This can be achieved by having an alphabet which is a 
Cartesian product of two alphabets, in our case E = {0, 1, 4f} x {0, 1, #}■ Then, 
the tape Hilbert space 7^t can be written as TLt = Hi (8 Ho . 

Definition 1 (Quantum Turing Machine (QTM)). 

A partial map M : T 1 + (7i{ ,i}*) ~~ * ^i + (^{o,i}* ) w ^ oe called a QTM, if there 
is a Bernstein- Vazirani two-track QTM M — (S.Q,5) (see yj[, Def. 3.5.5) with 
the following properties: 

-JC = {0,l,#}x {0,1, #}, 

— the corresponding time evolution operator U^j is unitary, 

— if M halts on input a with a variable-length qubit string p G T 1 + (7i{ ,i}* ) 
on the output track starting in cell such that the i-th cell is empty for every 
i [0,£(p) — 1], then M(a) — p; otherwise, M{a) is undefined. 

In general, different inputs a have different halting times t and the correspond- 
ing outputs are essentially results of different unitary transformations given by 
U l M . However, as the subset of (yi.{ Q iy) on which M is defined is of the form 
UteN T^~{H{t)), the action of the partial map M on this subset may be extended 
to a valid quantum operation 3 on T(H{o,i}*)'- 

Lemma 1 (QTMs are Quantum Operations). 

For every QTM M there is a quantum operation M : T(7i{ — > T(TL^ : \y), 
such that for every a G UteN 1~^{H(t)) 

M(a) =M{a). 

Proof. Let Bt and B± be an orthonormal basis of H(t), t € N, and the or- 
thogonal complement of Q) te faH(t) within 7i{o,i}*, respectively. We add an an- 
cilla Hilbert space Ha '•= ^ 2 (No) to the QTM, and define a linear operator 



3 Recall that quantum operations are trace-preserving completely positive maps on the trace- 
class operators Ti^hCj on the system Hilbert space Ti., see 1181 . 
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Vm '■ W{o,i}* — > 7~£qtm <8> "Ha by specifying its action on the orthonormal basis 
vectors Ut^nBt U B±: 

VmW - \ \b) ® |0) if 1 6) e B ± . (7) 

Since the right hand side of is a set of orthonormal vectors in TCqtm ® 
Ha, the map Vm is a partial isometry. Thus, the map a i— > Vm&V m is trace- 
preserving, completely positive (|31|'l. Its composition with the partial trace, 
given by M.(a) := Ttc,h,i,a(Vmo'Vm)j ^ s a quantum operation. □ 

4-- 3. Quantum Algorithmic Complexity. The typical case we want to study is 
the (approximate) reproduction of a density matrix p £ T 1 h (A^) by a QTM 
M. This means that there is a "quantum program" a £ 7^ + (7i{ 0jl }» ), such that 
M(a) w p in a sense explained below. 

We are particularly interested in the case that the program a is shorter than 
p itself, i.e. that £(a) < i(p). On the whole, the minimum possible length £(a) 
for p will be defined as the quantum algorithmic complexity of p. 

As already mentioned, there are at least two natural possible definitions. The 
first one is to demand only approximate reproduction of p within some trace 
distance d. The second one is based on the notion of an approximation scheme. 
To define the latter, we have to specify what we mean by supplying a QTM with 
two inputs, the qubit string and a parameter: 

Definition 2 (Parameter Encoding). 

Let k £ N and a £ T L + (7i{ ,i}*)- ^ e define an encoding C : N x T L + (7i{ ,i}*) ~~ ► 
7^ + (7i{ 0jl }. ) of a pair (k,a) into a single string C(k, a) by 

C(k,a) := \%){k\®a , 

where k denotes the (classical) string consisting of \\ogk\ I's, followed by one 
0, followed by the \logk\ + 1 binary digits of k, and |A:)(fc| is the corresponding 
projector in the computational basis' 1 . For every QTM M, we set 

M(k,a) := M{C{k,a)) . 

Note that 

£(C(k.a)) = 2 Llog fcj +2 + £(a). (8) 

The QTM M has to be constructed in such a way that it is able to decode 
both k and a from C(k, a), which is an easy classical task. 

Definition 3 (Quantum Algorithmic Complexity). 

Let M be a QTM and p € ^l + (W{o,u*) a, gubit string. For every S > 0, we define 
the finite-accuracy quantum complexity QC M (p) as the minimal length £{o~) of 
any quantum program a £ T L + (7i{ iy ) such that the corresponding output M(a) 
has trace distance from p smaller than 5, 

QC S M (p):=mm{£(a) \ \\p~M(a)\\ Tl <S} . (9) 

4 We use the notations \x\ = max{n £ N | n < x} and \x] = min{n S N | n > x}. 
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Similarly, we define an approximation-scheme quantum complexity QC^° by 
the minimal length £(o~) of any density operator a £ T L + (7i{ .i}*); such that 
when given M as input together with any integer k, the output M(k, a) has trace 
distance from p smaller than 1/k: 



QC^{p) :=xmn\l{u) 



\\p- M(k,a)\\ Tr < r for every k £ N }■ . ( 1.0) 
k ' 



Some points are worth stressing in connection with the previous definition: 

— This definition is essentially equivalent to the definition given by Berthiaume 
et. al. in [S]. The only technical difference is that we found it convenient to 
use the trace distance rather than the fidelity. 

— The same qubit program a is accompanied by a classical specification of an 
integer k, which tells the program to what accuracy the computation of the 
output state must be accomplished. 

— If Al does not have too restricted functionality (for example, if M is univer- 
sal, which is discussed below), a noiseless transmission channel (implementing 
the identity transformation) between the input and output tracks can always 
be realized: this corresponds to classical literal transcription, so that auto- 
matically QC M (p) < £(p) + cm for some constant cm- Of course, the key 
point in classical as well as quantum algorithmic complexity is that there are 
sometimes much shorter qubit programs than literal transcription. 

— The exact choice of the accuracy specification \ is not important; we can 
choose any computable function that tends to zero for k — > oo, and we will 
always get an equivalent definition (in the sense of being equal up to some 
constant). 

The same is true for the choice of the encoding C: As long as k and a can 
both be computably decoded from C(k,a) and as long as there is no way to 
extract additional information on the desired output p from the ^-description 
part of C(k,o~), the results will be equivalent up to some constant. 

Both quantum algorithmic complexities QC S and QC^° are related to each 
other in a useful way: 

Lemma 2 (Relation between Q-Complexities). For every QTM Al and 
every k £ N, we have the relation 

QCl( k ( P ) < QC]f{p) + 2[\ogk\ +2, p £ T+(H mv ). (11) 

Proof. Suppose that QC M ^{p) = Z, so there is a density matrix a £ T^(H{ _!}») 
with £(a) = I, such that \\M(k, cr)-p||Tr < \ for every k £ N. Then a 1 := C(k, a), 
where C is given in Definition|21 is an input for M such that ||M(cr') — p||Tr < \- 

Thus QC^ k (p) < £{a') < 2 [log fcj + 2 + £(a) = 2 [log fcj + 2 + QC*^°(p), where 
the second inequality is by iJSJ. □ 

The term 2 [log k\ + 2 in (|llf> depends on our encoding C given in Definition^ 
but if M is assumed to be universal (which will be discussed below), then i|ll[l 
will hold for every encoding, if we replace the term 2[logfcJ + 2 by K(k) + 
where K(k) < 2|logfcJ +0(1) denotes the classical (self-delimiting) algorithmic 
complexity of the integer k, and cm is some constant depending only on M. For 
more details we refer the reader to . 
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In Hj , it is proved that there is a universal QTM ( UQTM) il that can simulate 
with arbitrary accuracy every other machine M in the sense that for every such 
M there is a classical bit string M £ {0, 1}* such that 

||U(M,ff,M)-MS(o-)|hv<i foreveryaeT+(H {0)ir ), (12) 

where fe,teN. As it is implicit in this definition of universality, we will demand 
that 11 is able to perfectly simulate every classical computation, and that it can 
apply a given unitary transformation within any desired accuracy (it is shown 
in 0] that such machines exist). 

We choose an arbitrary UQTM il which is constructed such that it decodes 
our encoding C(k,<r) given in Definition into k and a at the beginning of the 
computation. Like in the classical case, we fix il for the rest of the paper and 
simplify notation by 

QC^°(p) := QC^°( P ) 7 QC 5 (p) := QC^p) . 



5. Proof of the Main Theorem 

As already mentioned at the beginning of Section |2 without loss of generality, 
we give the proofs for the case that A is the algebra of the observables of a qubit, 
i.e. the complex 2 x 2-matrices. 



5.1. Lower Bound. For classical TMs, there are no more than 2 C+1 — 1 different 
programs of length £ < c. This can be used as a " counting argument" for proving 
the lower bound of Brudno's Theorem in the classical case ( [22| ) . We are now 
going to prove a similar statement for QTMs. 

Our first step is to elaborate on an argument due to j3] which states that there 
cannot be more than 2 i+1 — 1 mutually orthogonal one-dimensional projectors 
p with quantum complexity QC" Sd °(p) < £. The argument is based on Holevo's 
X-quantity associated to any ensemble E p := {Ai, pi} i consisting of weights < 
Aj < 1, y] { Xj — 1, and of density matrices pi acting on a Hilbert space Ti. 
Setting p := J^. Aip^, the x-quantity is defined as follows 

X (E P ) :=S(p) - ]TA 4 S( Pl ) (13) 

i 

= J2^S( Pt ,p), (14) 

i 

where, in the second line, the relative entropy appears 

S(pi pi) ■= I Tt {p i { 1o ^P 1 ~ lo g^)) if supp pi < supp p 2 , / 15 j 
[ oo otherwise. 

If dim(7i) is finite, l|13fl is bounded by the maximal von Neumann entropy: 

x(E p )<5(p)<logdim(H). (16) 

In the following, TC denotes an arbitrary (possibly infinite-dimensional) 
Hilbert space, while the rest of the notation is adopted from Subsection l4.2l 
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Lemma 3 (Quantum Counting Argument). Let < S < 1/e. c G N smc/i 
that c > | (2 + log P an orthogonal projector onto a linear subspace of an 
arbitrary Hilbert space TC ', and £ : T L + (7i{ ,i}*) ~~ * C^O a quantum operation. 
Let Nfi be a subset of one- dimensional mutually orthogonal projections from the 
set 

A S C (£,P) :={p<P\p 1-dim. proj.,3a £ T+(H< C ) : \\£(a) - p\\ Tl < 5}, 

that is, the set of all pure quantum states which are reproduced within 5 by the 
operation £ on some input of length < c. Then it holds that 



\og\N d ;\<c+l + f-^5c. 

Proof. Let pj £ A S C {£,P), j = 1,...,N, be a set of mutually orthogonal 
projectors and pn+i '■= 1«' - Ei=iP<- B y the definition of A s c (£, P), for every 
1 < i < N, there are density matrices (jj £ Tj + (7i< c ) with 

\\£(0-i)-pi\\Tr<5 . (17) 

1 N 

Consider the equidistributed ensemble E CT := where a :— — crj also 

i=\ 

acts on Ti< c . Using that dim7i< c = 2 C+1 — 1, inequality Hl(jf> yields 

X(E CT )< C +1. (18) 

We define a quantum operation 7Z on 7^ + (7i') by 1Z(a) :— Eil^ 1 Pi a Pi- Applying 
twice the monotonicity of the relative entropy under quantum operations, we 
obtain 

N N 
-J2S(no£(a l ),TZo£(a))<-Y / S(£(a l ) 1 £(a))< X (E a ) . (19) 

i=l i=l 

Moreover, for every i £ {1, . . . , N}, the density operator 1Zo£{ai) is close to the 
corresponding one-dimensional projector lZ(pi) — pi. Indeed, by the contractiv- 
ity of the trace distance under quantum operations (compare Thm. 9.2 in |29p 
and by assumption (|17fl . it holds 

WRo£(a l )-p l \\ T r < \\£(a l )- Pl \\ Tr <S . 
Let A := -k Ei=iPv The trace-distance is convex (jUj, (9.51)), thus 

1 N 

\\K o £(a) -A\\ Tl <-J2\\Ko £(a l ) - Pl \\ Tr < S , 
i=i 

whence, since 8 < -, Fannes' inequality (compare Thm. 11.6 in [2SJ ) gives 

S(K o £(o-i)) = \S{K o £(o-i)) - S(pi)\ < 6log{N + 1) + rj{6) 
and \S(Ko£(a))- S(A)\ < S log(iV + 1) + rj(S) , 



2 + 6 
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where r)(S) := — <5 log <5. Combining the two estimates above with (|18|l and (|19|) . 
we obtain 



c + 1 > > S(K o £{&)) -^J2s(Ko S(ai)) 

i=i 

1 N 

>S(A)-5 log(JV + 1) - - T7 £ (<* + !) + 



N 
i=i 

= log TV - 2(51og(7V + 1) - 2t,(<5) 

> (1 -2tf)logiV- 2^- 277(5). (20) 

Assume now that logiV > c + 1 + j^Sc. Then it follows (J201 that c < 
| (2 + log 4). So if c is larger than this expression, the maximum number |JV*| 
of mutually orthogonal projectors in A S C (£,P) must be bounded by log|iV*| < 

1 2 + 6 r 

The second step uses the previous lemma together with the following theorem 
Prop. 2.1]. It is closely related to the quantum Shannon-McMillan Theorem 
and concerns the minimal dimension of the \P— typical subspaces. 

Theorem 2. Let (A°° be an ergodic quantum source with entropy rate s. 
Then, for every < e < 1, 

lim -&,„(#) = s, (21) 

n — >oo 77, 

where /3 E ,nO^) : = mm {logTr n (g) | 3 S projector , i^™)^) > 1 — e}. 

Notice that the limit lj21|l is valid for all < e < 1 . By means of this property, 
we will first prove the lower bound for the finite- accuracy complexity QC S , and 
then use Lemma to extend it to QC^ . 

Corollary 1 (Lower Bound for —QC 5 ). 

Let (A°° be an ergodic quantum source with entropy rate s. Moreover, let 
< S < 1/e, and let (p n )„ e N be a sequence of \P -typical projectors. Then, there 
is another sequence of \P -typical projectors q n ($) _• Pn, such that for n large 
enough 

-QC s (q) > s-S(2 + S)s 
n 

is true for every one- dimensional projector q < q n (5). 

Proof. The case s = is trivial, so let s > 0. Fix n £ N and some < 8 < 1/e, 
and consider the set 

A n (5) := {p <p„\ p one-dim. proj., QC s (p) < ns(l - 8(2 + 5))} . 

From the definition of QC s (p), to all p's there exist associated density ma- 
trices a p with £(a p ) < ns(l — 6(2 + 5)) such that \\M(cr p ) — p\\t t < 6, where M 
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denotes the quantum operation M : T x (Tiuvi}*) — > T L + (7Y{ ,i}* ) 01 tne corre- 
sponding UQTM il, as explained in Lemma Q Using the notation of Lemma 
it thus follows that 

A n {5) C if 

ns(l-rS(2+<5))] (^)Pn) ■ 

Let p n (6) < p n be a sum of a maximal number of mutually orthogonal projectors 
from Ar na / 1 _ <5 / 2 +j))] (-A4)Pn)' If " was chosen large enough such that ras(l — 5(2 + 
(5)) > ^ (4 + 2 log |) is satisfied, Lemma [3] implies that 

logTrp n (5) < lns(l-5(2 + 6))]+l + P^-5\ns(l-6(2 + 6))], (22) 

1 — 2d 

and there are no one-dimensional projectors p < p n {S) '■— Pn — Pn(S) such that 
p G J 4fns(i-5(2+5))] (^iPn)) Namely, one-dimensional projectors p < PniS) 1 " 
must satisfy ^QC 5 (p) > s — S(2 + S)s. Since inequality 12211 is valid for every 
neN large enough, we conclude 

1 5S 4 s 
limsup - logTr„p„(<J) < s - 2S 3 s - — — < s. (23) 

n — >oo 1 ^0 

Using Theorem|21 we obtain that limn-^ (p n (S)) = 0. Finally, set q n {6) := 
Pn($) ■ The claim follows. □ 

Corollary 2 (Lower Bound for ^QC^°). 

Let (A 00 ,^) be an ergodic quantum source with entropy rate s. Let (p n ) ngN 
with p n G A^ 1 ' be an arbitrary sequence of \P -typical projectors. Then, for every 
< 5 < 1/e, there is a sequence of -typical projectors q n {$) < Pn such that for 
n large enough 

-QC^°(q) > s-S 
n 

is satisfied for every one- dimensional projector q < q n (S). 

Proof. According to Corollary ^ f°r every k G N, there exists a sequence 
of ^-typical projectors p n {\) < Pn with ^QCi(q) > s - |(2 + |)s for every 
one-dimensional projector q < p n {\) if n is large enough. We have 



-QC^\q)>-QC 1 ' k {q)- 



2 + 2 Llog fcj 



n n 



>s-U2 + ^s- 2{2 + l ° Sk \ 



k \ k 

where the first estimate is by Lemma |5J and the second one is true for one- 
dimensional projectors q < p n (h) an d n € N large enough. Fix a large k satisfy- 
ing r(2 + r)s < |. The result follows by setting q n {§) — p n {x)- D 
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5.2. Upper Bound. In the previous section, we have shown that with high prob- 
ability and for large m, the finite-accuracy complexity rate -^QC 5 is bounded 
from below by s(l — 5(2 + 6)), and the approximation-scheme quantum com- 
plexity rate ^QC^ by s — 5. We are now going to establish the upper bounds. 

Proposition 1 (Upper Bound). 

Let (A 00 ,^) be an ergodic quantum source with entropy rate s. Then, for every 
< S < 1/e, there is a sequence of \P -typical projectors q m (8) & A^ 71 ' such that 
for every one- dimensional projector q < q m (S) and m large enough 

— QC^°(q)<s + S and (24) 

TO 

-QC s {q) < s + S . (25) 
m 

We prove the above proposition by explicitly providing a quantum algorithm 
(with program length increasing like m(s + 5)) that computes q within arbitrary 
accuracy. This will be done by means of quantum universal typical subspaces 
constructed by Kaltchenko and Yang in |21j . 

Theorem 3 (Universal Typical Subspaces). 

Let s > and e > 0. There exists a sequence of projectors Qs™e € A^ n \ n £ N, 
such that for n large enough 

Tr(QW) < 2" (s+e) (26) 

and for every ergodic quantum state & £ S(A°°) with entropy rate s^) < s it 
holds that 

lim W w (QW) =1 • (27) 

71 — >00 ' 

(n) 

We call the orthogonal projectors Q S J in the above theorem universal typical 
projectors at level s. Suited for designing an appropriate quantum algorithm, we 
slightly modify the proof given by Kaltchenko and Yang in |21) . 

Proof. Let I £ N and R > 0. We consider an Abelian quasi-local subalgebra 
Cf° C A°° constructed from a maximal Abelian /—block subalgebra Ci C A^ . 
The results in |42U23j imply that there exists a universal sequence of projectors 
€ C\ n) C A^ with ilogTrpg < R such that li^ tt^ (pg) = 1 
for any ergodic state tt on the Abelian algebra Cf with entropy rate s(ir) < R. 
Notice that ergodicity and entropy rate of tt are defined with respect to the shift 
on C;°° , which corresponds to the /-shift on A°° . 

The first step in |2J is to apply unitary operators of the form U® r ' , U £ A^ 
unitary, to the and to introduce the projectors 

w$ := V U® n P l n lu*® n £A i - ln) . (28) 
UeACi unitary 
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Let pf n ^ — J^iei NiaX^fll ^ e a s P ec tral decomposition of p^ (with IcN some 
index set), and let P(V) denote the orthogonal projector onto a given subspace 
V. Then, wf 1 ^ can also be written as 

= p ( S pan{J7® n |ig) :ieI,Ue A {1) unitary} 

It will be more convenient for the construction of our algorithm in 15.2.11 to 
consider the projector 

W$ := P (span{A® n |ig) : % E I, A e A {1) }) . (29) 

It holds that wf^ < . For integers m = nl + k with n S N and fc S 

{0, ... ,1— 1} we introduce the projectors in A^ 

w Im ■■= W ?,R ® !^ : = wff ® l9k - ( 3 °) 

We now use an argument of [201 to estimate the trace of £ A^- m \ The 

dimension of the symmetric subspace SYM"(„4^) := span{y4® n : A e A®} is 
upper bounded by (n + i)dim-4 (!) ^ thus 

Tr W$ = Tr W$ ■ Tr l® k < (n + l^Tr pg • 2 l 

< (n + If 2 ' ■ 2 Rn ■ 2 l . (31) 

Now we consider a stationary ergodic state \P on the quasi-local algebra A°° 
with entropy rate s(tf') < s. Let e, 8 > 0. If I is chosen large enough then the 

projectors w\™^ , where R := 2(s+|), are 5— typical for i.e. ^^ m H tt, j'fl ) — 1 — <^ 
for m € N sufficiently large. This can be seen as follows. Due to the result in 
Thm. 3.1] the ergodic state 9 convexly decomposes into k(l) < I states 

fe(0 

*=Mog>' (32) 

each <Pij being ergodic with respect to the Z — shift on A°° and having an entropy 
rate (with respect to the I— shift) equal to s(\P) ■ I. We define for A > the set 
of integers 

A UA :={»6{1 k(l)} : S(S$) > 1(8(9) + A)}. (33) 

Then, according to a density lemma proven in Lemma 3.1] it holds 

lim J^l = 0. (34) 
i-+oo k(lj 

Let Cij be the maximal Abelian subalgebra of A^ generated by the one- 
dimensional eigenprojectors of 3^9 G 5(,A^). The restriction of a component 
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tf^z to the Abelian quasi-local algebra Cf\ is again an ergodic state. It holds in 
general 

I ■ = s(*u) < \ C??) < S(S$ \ C M ) = S(S$). (35) 

For i £ Af A , where we set A := j — s we additionally have the upper bound 

S^/J) < fl. Let t/, £ be a unitary operator such that Uf "pfyu*® 71 £ C\f . 
For every i £ Af A , it holds that 

^ (^?h ) > ^J n) (^f >S^® n ) — 1 as n -> oo. (36) 

We fix an I £ N large enough to fulfill > 1 — | and use the ergodic 

decomposition 1321) to obtain the lower bound 



From (|36|l we conclude that for n large enough 

#(ln) {w (ln) j > ^(In) (u) (l») ) > 1 _ 5 . ( 38 ) 

We proceed by following the lines of |5J by introducing the sequence l m , to £ N, 
where each l rn is a power of 2 fulfilling the inequality 

l m 2 34m < to < 2l m 2 3 21 ™. (39) 

Let the integer sequence n m and the real-valued sequence R m be defined by 
n m '■= Lt^J anc ^ ■— lm ' ( s + §)■ Then we set 

gW,Kt; ifm = / m 2^ ! 

V., e ■ ^ W ? m gn) g, !®(m-Un m ) oth e rw ise . 1 J 



Observe that 



llogTrQM < -i-logTrQ^ 

771 Tim^m 

< 4'- log(n m + 1) + H 1 (41) 
4'- 6Z m + 2 e 1 

^^-T + s+ 2 + 2^-T' < 42 > 

where the second inequality is by estimate (|31|l and the last one by the bounds 
on n m 

2 3< m _ 1 < HL _ i < „ m < ^ < 2 6; -+ 1 . 
Thus, for large to, it holds 

-logTr Q(™) < s + e. (43) 

TO 
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By the special choice l|39l) of l m it is ensured that the sequence of projectors 

Qs™ S A^ is indeed typical for any quantum state W with entropy rate s(^) < 

s, compare [2U - This means that {Qi™^} m eN is a sequence of universal typical 
projectors at level s. □ 

5.2.1. Construction of the Decompression Algorithm. We proceed by applying 
the latter result to universal typical subspaces for our proof of the upper bound. 
Let < e < 6/2 be an arbitrary real number such that r := s + e is rational, 

and let q m := Q^e 1 be the universal projector sequence of Theorem Recall 
that the projector sequence q m is independent of the choice of the ergodic state 
as long as s(tf') < s. 

Because of (|26f) . for m large enough, there exists some unitary transformation 
U* that transforms the projector q m into a projector belonging to XH\ mr ~\) , 
thus transforming every one-dimensional projector q < q m into a qubit string 
q := U*qU of length £(q) = \mr~\ . 

As shown in 4, a UQTM can implement every classical algorithm, and it 
can apply every unitary transformation U (when given an algorithm for the 
computation of U) on its tapes within any desired accuracy. We can thus feed 
q (plus some classical instructions including a subprogram for the computation 
of U) as input into the UQTM 11. This UQTM starts by computing a classical 
description of the transformation U, and subsequently applies U to q, recovering 
the original projector q = UqU* on the output tape. 

Since U = U(q m ) depends on & only through its entropy rate s(iP), the 
subprogram that computes U does not have to be supplied with additional in- 
formation on W and will thus have fixed length. 

We give a precise definition of a quantum decompression algorithm 21, which 
is, formally, a mapping (r is rational) 

21 : N x N x Q x W {0)1} , -> H {0<1} . , 
(k, m,r,q) i— > q — 2l(fc, m, r, q) . 

We require that 21 is a " short algorithm" in the sense of " short in description" , 
not short (fast) in running time or resource consumption. Indeed, the algorithm 21 
is very slow and memory consuming, but this does not matter, since Kolmogorov 
complexity only cares about the description length of the program. 
The instructions defining the quantum algorithm 21 are: 

1. Read the value of m, and find a solution I € N for the inequality 

I ■ 2 31 < m < 2 ■ I ■ 2 3 21 

such that / is a power of two. (There is only one such I.) 

2. Compute n := [_fj- 

3. Read the value of r. Compute R:= I ■ r. 

4. Compute a list of codewords ^^1, belonging to a classical universal block 
code sequence of rate R. (For the construction of an appropriate algorithm, 
see [HI Thm. 2 and 1].) Since 

<ic({o,i}0" , 
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^Ar = w 2 7 ■ • ■ i %} can be stored as a list of binary strings. Every string 
has length l(uii) = nl. (Note that the exact value of the cardinality M ~ 2 nR 
depends on the choice of ^^-) 

During the following steps, the quantum algorithm 21 will have to deal with 

— rational numbers, 

— square roots of rational numbers, 

— binary-digit-approximations (up to some specified accuracy) of real numbers, 

— (large) vectors and matrices containing such numbers. 

A classical TM can of course deal with all such objects (and so can QTM): For 
example, rational numbers can be stored as a list of two integers (containing 
numerator and denominator), square roots can be stored as such a list and an 
additional bit denoting the square root, and binary-digit- approximations can 
be stored as binary strings. Vectors and matrices are arrays containing those 
objects. They are always assumed to be given in the computational basis. Oper- 
ations on those objects, like addition or multiplication, are easily implemented. 
The quantum algorithm 21 continues as follows: 

5. Compute a basis {Ar^, »„}} of the symmetric subspace 

SYM n (ylW) := span{A®" : A e A {1) } . 

This can be done as follows: For every n-tuple {ii, . . . ,i n }, where ik € 
{1,...,2 2/ }, there is one basis element Au t i^y € A" n \ given by the for- 
mula 

An,...,„}=E e 5?,..,„)' ( 44 ) 

a 

where the summation runs over all n-permutations a, and 
e^L :=e!>e!>...^, 

2 2 ' 

with I 6 !'''! a system of matrix units D in A^. 

There is a number of d = ^t™-~x) = dim(SYM"(^W)) different matrices 

Afii,...,i n } which we can label by {Afe} fc=1 . It follows from 144JI that these 
matrices have integer entries. 

They are stored as a list of 2 ln x 2'™-tables of integers. Thus, this step of the 
computation is exact, that is without approximations. 

6. For every i e {1, . . . , M} and k € {1, . . . , d}, let 

\v>k,i) ■= A k \u>i) , 

where |o;,-) denotes the computational basis vector which is a tensor product 
of |0)'s and |l)'s according to the bits of the string Wj. Compute the vectors 
\uk,i) one after the other. For every vector that has been computed, check if 
it can be written as a linear combination of already computed vectors. (The 
corresponding system of linear equations can be solved exactly, since every 



In the computational basis, all entries are zero, except for one entry which is one. 
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vector is given as an array of integers.) If yes, then discard the new vector 
\uk,i), otherwise store it and give it a number. 

This way, a set of vectors {|wfc)}^ =1 is computed. These vectors linearly span 
the support of the projector given in (|29[) . 

7. Denote by {\4>i)}^ =1 the computational basis vectors ofH. m -in- If to = l-2 3 '\ 
then let D := D, and let \xk) '■= \uk)- Otherwise, compute \uk)^\(j>i) for every 
k € {1, . . . ,-D} and i € {1, . . . , 2™"'™}. The resulting set of vectors {|x fc )}f =1 
has cardinality D := D ■ 2 m ~ ln . 

In both cases, the resulting vectors \x k ) S TC m will span the support of the 
projector Q { ™e = q m . 

8. The set {\xk}} k= i is completed to linearly span the whole space H m . This 
will be accomplished as follows: 

Consider the sequence of vectors 

\x 2 ), . . . , \x b+2m )) := (|xi), |a? 2 >, ■ ■ ■ , \xq), |$i>, |#2>, . . . , |*2»», 

where {^fc}^ =1 denotes the computational basis vectors of H m . Find 
the smallest i such that \xi) can be written as a linear combination of 
|x2), . • • , \xi-i), and discard it (this can still be decided exactly, since 
all the vectors are given as tables of integers) . Repeat this step D times until 
there remain only 2 m linearly independent vectors, namely all the \xj) and 
2 m — D of the 

9. Apply the Gram-Schmidt orthonormalization procedure to the resulting vec- 
tors, to get an orthonormal basis {\yk)} k=1 of H m , such that the first D 
vectors are a basis for the support of Qsfe — Qm- 

Since every vector \xj) and \<Pj) has only integer entries, all the resulting 
vectors \yk) will have only entries that are (plus or minus) the square root of 
some rational number. 

Up to this point, every calculation was exact without any numerical error, 
comparable to the way that well-known computer algebra systems work. The 
goal of the next steps is to compute an approximate description of the desired 
unitary decompression map U and subsequently apply it to the quantum state 

According to Section 6 in 0], a UQTM is able to apply a unitary transforma- 
tion U on some segment of its tape within an accuracy of S, if it is supplied with 
a complex matrix U as input which is within operator norm distance 2 (ioVd) d 
of U (here, d denotes the size of the matrix). Thus, the next task is to compute 
the number of digits N that are necessary to guarantee that the output will be 
within trace distance 8 — i of q. 

10. Read the value of k (which denotes an approximation parameter; the larger 
k, the more accurate the output of the algorithm will be). Due to the consid- 
erations above and the calculations below, the necessary number of digits TV 
turns out to be N = 1 + [log(2fc2 m (10\/2" r ) 2m )l . Compute this number. 

Afterwards, compute the components of all the vectors {\yk)}k=i U P to N 
binary digits of accuracy. (This involves only calculation of the square root 
of rational numbers, which can easily be done to any desired accuracy.) 
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Call the resulting numerically approximated vectors \yk)- Write them as 

columns into an array (a matrix) U := (t/i, y 2 , ■ ■ ■ , y2 m )- 

Let U := (j/i,2/2, - •■ ,y2 m ) denote the unitary matrix with the exact vectors 

\yk) as columns. Since N binary digits give an accuracy of 2~ N , it follows 

that 



2 • 2 m (10V2^) 2 " 



If two 2 m x 2 m -matriccs U and U are e-close in their entries, they also must 
be 2 m • e-close in norm, so we get 

\\u-u\\< 1/k 



2(10V2™) 2 



So far, every step was purely classical and could have been done on a classical 
computer. Now, the quantum part begins: q will be touched for the first time. 

11. Compute \mr~\ , which gives the length £(q). Afterwards, move q to some free 
space on the input tape, and append zeroes, i.e. create the state 



|^o)(Vo|:=(|0)(0|)^ ro -^» 



q 



on some segment of m cells on the input tape. 
12. Approximately apply the unitary transformation U on the tape segment that 
contains the state q' . 

The machine cannot apply U exactly (since it only knows an approximation 
U), and it also cannot apply U directly (since U is only approximately uni- 
tary, and the machine can only do unitary transformations). Instead, it will 
effectively apply another unitary transformation V which is close to U and 
thus close to U, such that 

iv-ui<\. 

Let \ip) := U\tpo) be the output that we want to have, and let \<j>) := V\tj)o) 
be the approximation that is really computed by the machine. Then, 

\\\<t>)-m\<\- 

A simple calculation proves that the trace distance must then also be small: 

1 



14. Move q := \(f>){<t>\ to the output tape and halt. 



Entropy and Quantum Kolmogorov Complexity: A Quantum Brudno's Theorem 



23 



5.2.2. Proof of Proposition^ We have to give a precise definition how the pa- 
rameters (m,r,q) are encoded into a single qubit string a. (According to the 
definition of QC^ , the parameter k is not a part of er, but is given as a second 
parameter. See Definitions [21 and [3] for details.) 

We choose to encode m by giving [log ttzJ l's, followed by one 0, followed 
by the [log ttt,J + 1 binary digits of m. Let \M)(M\ denote the corresponding 
projector in the computational basis. 

The parameter r can be encoded in any way, since it does not depend on m. 
The only constraint is that the description must be self-delimiting, i.e. it must 
be clear and decidable at what position the description for r starts and ends. 
The descriptions will also be given by a computational basis vector (or rather 
the corresponding projector) \R)(R\. 

The descriptions are then stuck together, and the input o~(q) is given by 

a(q) := \M)(M\ <g> \R){R\<g>q. 

If m is large enough such that (|43|l is fulfilled, it follows that £(cr(q)) — 2 [log m\ + 
2 + c + \mr \ , where c € N is some constant which depends on r, but not on m. 

It is clear that this qubit string can be fed into the reference UQTMU. together 
with a description of the algorithm 21 of fixed length d which depends on r, but 
not on m. This will give a qubit string eru(g) of length 

= 2|_logmJ + 2 + c+ \mr \ +c 

< 2 log m + m(s+^6^j + c" , (45) 

where c" is again a constant which depends on r, but not on m. Recall the matrix 
U constructed in step 11 of our algorithm 21, which rotates (decompresses) a 
compressed (short) qubit string q back into the typical subspace. Conversely, for 

every one-dimensional projector q < q m , where q m — Qi™' was defined in (|40(l . 
let q e n [mr] be the projector given by (|0)(0|)^ (m ~ rmrl) ® q = U*qU. Then, 
since 21 has been constructed such that 

\\ii(cr u (q), k) - q\\ Tl < - for every k e N , 
it follows from g5J) that 

±QC^(q)<2 1 ^ + S + h+ C -. 
m m 2 m 

If m is large enough, Equation (|24|l follows. 

Now we continue by proving Equation (|25J) . Let k := log] ■ Then, we have for 
every one-dimensional projector q < q m and m large enough 

~QC 2S (q) < -QC^(q) < -QC^(q) + 

m m m m 

<s + 6 + 2l0gk + 2 <s + 2S, (46) 
m 

where the first inequality follows from the obvious monotonicity property 8 > 
£ ^> QC S < QC £ , the second one is by Lemma [21 and the third estimate is due 
to Equation (J2IJ. □ 
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Proof of the Main Theorem^ Let q m (5) be the tf'-typical projector sequence 
given in Proposition ^ i>e. the complexities t^QC^ and -^QC 5 of every one- 
dimensional projector q < q m (5) are upper bounded by s + S. Due to Corollary^ 
there exists another sequence of If"- typical projectors p m {5) < q m (fi) such that 
additionally, ^QC s (q) > s— S(2+S)s is satisfied for q < p m (S). From Corollary|21 
we can further deduce that there is another sequence of ^-typical projectors 
<7m (8) < Pm{8) such that also ^QC^" (q) > s — 5 holds. Finally, the optimality 
assertion is a direct consequence of the Quantum Counting Argument, Lemma 
combined with Theorem [5] □ 

6. Summary and Perspectives 

Classical algorithmic complexity theory as initiated by Kolmogorov, Chaitin and 
Solomonoff aimed at giving firm mathematical ground to the intuitive notion of 
randomness. The idea is that random objects cannot have short descriptions. 
Such an approach is on the one hand equivalent to Martin-L6f 's which is based 
on the notion of typicalness |39| , and is on the other hand intimately connected 
with the notion of entropy. The latter relation is best exemplified in the case of 
longer and longer strings: by taking the ratio of the complexity with respect to 
the number of bits, one gets a complexity per symbol which a theorem of Brudno 
shows to be equal to the entropy per symbol of almost all sequences emitted by 
ergodic sources. 

The fast development of quantum information and computation, with the 
formalization of the concept of UQTMs, quite naturally brought with itself the 
need of extending the notion of algorithmic complexity to the quantum setting. 
Within such a broader context, the ultimate goal is again a mathematical theory 
of the randomness of quantum objects. There are two possible algorithmic de- 
scriptions of qubit strings: either by means of bit-programs or of qubit-programs. 
In this work, we have considered a qubit-based quantum algorithmic complexity, 
namely constructed in terms of quantum descriptions of quantum objects. 

The main result of this paper is an extension of Brudno's theorem to the quan- 
tum setting, though in a slightly weaker form which is due to the absence of a 
natural concatenation of qubits. The quantum Brudno's relation proved in this 
paper is not a pointwise relation as in the classical case, rather a kind of conver- 
gence in probability which connects the quantum complexity per qubit with the 
von Neumann entropy rate of quantum ergodic sources. Possible strengthening 
of this relation following the strategy which permits the formulation of a quan- 
tum Brciman theorem starting from the quantum Shannon-McMillan noiseless 
coding theorem [H] will be the matter of future investigations. 

In order to assert that this choice of quantum complexity as a formalization 
of "quantum randomness" is as good as its classical counterpart in relation to 
"classical randomness", one ought to compare it with the other proposals that 
have been put forward: not only with the quantum complexity based on classical 
descriptions of quantum objects |4(Jj . but also with the one based on the notion 
of universal density matrices |15| . 

In relation to Vitanyi's approach, the comparison essentially boils down to 
understanding whether a classical description of qubit strings requires more clas- 
sical bits than s qubits per Hilbert space dimension. An indication that this is 
likely to be the case may be related to the existence of entangled states. 
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In relation to Gacs' approach, the clue is provided by the possible formulation 
of "quantum Martin-L6f" tests in terms of measurement processes projecting 
onto low-probability subspaces, the quantum counterparts of classical untypical 
sets. 

One cannot however expect classical-like equivalences among the various defi- 
nitions. It is indeed a likely consequence of the very structure of quantum theory 
that a same classical notion may be extended in different inequivalent ways, all 
of them reflecting a specific aspect of that structure. This fact is most clearly 
seen in the case of quantum dynamical entropies (compare for instance [3]) where 
one definition can capture dynamical features which are precluded to another. 
Therefore, it is possible that there may exist different, equally suitable notions 
of "quantum randomness" , each one of them reflecting a different facet of it. 
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